

NASA Contractor Report 172336 


NASA-CR- 172336 
19840017633 


F-14 MODELING STUDY 


W. H. Levison and S. Baron 


BOLT BERANEK AND NEWMAN INC. 
Cambridge, Massachusetts 02238 


Contract NAS 1-16738 
May 1984 


LIBRARY CM 


1984 


NASA 

National Aeronautics and 
Space Administration 

Langley Research Center 

Hampton, Virginia 23665 


LANGLEY RESEARCH CENTER 
LIBRARY, NASA 
HAMPTON* VIRGINIA 




TABLE OP CONTENTS 


i 

« Page 

1. INTRODUCTION 1-1 

2. THE CLOSED-LOOP PILOT/SIMULATOR MODEL 2-1 

3. MODEL FORMULATION OF TASK 3-1 

4. RESULTS AND DISCUSSION 4-1 

5. CONCLUDING REMARKS 

6. REFERENCES 6-1 

APPENDIX A. LINEARIZED LINE-OF-SIGHT ERROR EQUATIONS A-l 

APPENDIX B. TARGET KINEMATICS B-l 

APPENDIX C. SYSTEM STATE EQUATIONS 

C.l Fully- Augmented Aircraft 

. C.2 Aircraft with Reduced-Order Augmentation C-ll 

C.3 System Dynamics Used for Pilot Modeling 


i 


LIST OF FIGURES 


Page 


i 


FIG. 2.1 
FIG. 3.1 

FIG. 3.2 

FIG. 3.3 

FIG. 3.4 

FIG. 3.5 

FIG. 3.6 

FIG. 3.7 

FIG. 3.8 

FIG. 4.1 
FIG. 4.2 

FIG. 4.3 

FIG. 4.4 
FIG. 4.5 

FIG. 4.6 

FIG. C.l 

FIG. C.2 
FIG. C.3 


PILOT/SIMULATOR MODEL 

COMPARISON OF MODEL PITCH-RATE RESPONSE TO 
SIMULATOR RESPONSE 

COMPARISON OF MODEL YAW-RATE RESPONSE TO 
SIMULATOR RESPONSE 

COMPARISON OF MODEL LOS RESPONSE IN ELEVATION TO 
SIMULATOR RESPONSE 

COMPARISON OF MODEL LOS RESPONSE IN AZIMUTH TO 
SIMULATOR RESPONSE 

COMPARISON OF THE ELEVATION LOS ERROR TRANSIENT 
RESPONSES OF THE FULL-STATE AND 3-STATE 
AUGMENTATION SYSTEM 

COMPARISON OF THE AZIMUTH LOS ERROR TRANSIENT 
RESPONSES OF THE FULL-STATE AND 3-STATE 
AUGMENTATION SYSTEM 

BODE PLOTS RELATING ELEVATION LOS ERROR TO PILOT 
CONTROL INPUT 

BODE PLOTS RELATING AZIMUTH LOS ERROR TO PILOT 
CONTROL INPUT 

EFFECT OF ATTENTION ON PREDICTED ERROR SCORES 
EFFECT OF OBSERVATION NOISE/SIGNAL RATIO ON 
PREDICTED ERROR SCORES 

EFFECT OF MOTOR NOISE/SIGNAL RATIO ON PREDICTED 
ERROR SCORE 

EFFECT OF TIME DELAY ON PREDICTED ERROR SCORE 
EFFECT OF CUEING ENVIRONMENT ON PREDICTED 
PERFORMANCE/WORKLOAD TRADEOFF 
PREDICTED PERFORMANCE/WORKLOAD TRADEOFF WITH 
VISUAL THRESHOLDS 

SYSTEM DYNAMICS USED FOR PILOT/VEHICLE MODEL 
ANALYSIS 

SYSTEM DYNAMICS FOR FULLY- AUGMENTED AIRCRAFT 
SYSTEM DYNAMICS FOR AIRCRAFT WITH REDUCED-ORDER 
AUGMENTATION 


2-2 

3-5 

3-7 

3- 9 
3-11- 
3-15 

3-17 

3-19 

3- 21 

4- 7 

4- 10 

4-11 

4-12 

4-15 

4-18 

C-3 

C-12 

C-17 




» 


ii 



LIST OF TABLES 


Page 


4 TABLE 3.1 TRIPLET INPUTS USED IN COMPUTER MODEL 3-4 

VERIFICATION 

TABLE 4.1 INITIAL SELECTION OF PILOT MODEL PARAMETERS 4-3 

TABLE 4.2 PREDICTED SD SCORES FOR BASELINE CONFIGURATION 4-6 

TABLE B.l TRANSFORMATION FROM TARGET TO PURSUER B-7 

COORDINATES 


iii 



ABSTRACT 


In this report we describe preliminary results in the * 

application of a closed-loop pilot/simulator model to the k 

analysis of some simulator fidelity issues in the context of an 
air-to-air target tracking task. The closed-loop model is 

described briefly. Then, problem simplifications that are 
employed to reduce computational costs are discussed. Finally, 
model results showing sensitivity of performance to various 
assumptions concerning the simulator and/or the pilot are 
presented. 
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SYMBOLS 


A 

D 

X 

PrP 

Qrq 


R,r 


U , U 


V, V 


31 

W, w 
X 

Y 
Z 
6 
e 

V 

Q, u) 


y 

A 


subscripts 

a 

e 


transformation matrix 

distance between target and pursuer 

identity matrix 

vehicle roll rate 

vehicle pitch rate 

vehicle yaw rate 

vehicle velocity along the X body axis 
vehicle velocity along the Y body axis 
vector vehicle velocity: [U,V,W] 
vehicle velocity along the Z body axis 
front-back body axis, positive forward 
left-right body axis, positive rightward 
vertical body axis, positive downward 
control input 

Euler pitch angle. Also Jq 
Euler bank angle. Also *p 
Heading angle. Also ; r 

vehicle rotation matrix (defined in text) 
line-of-sight angle in elevation 
line-of-sight angle in azimuth 


aileron 

"error" (deviation from trim); Also elevator. 
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X 


refers to inertial coordinate frame 
o steady-state trim condition 

P pilot 

P refers to pursuer body coordinate frame 

r rudder 

t throttle 

T refers to target body 
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1. INTRODUCTION 

Both the military and civilian segments of aviation are 
placing an increasing reliance on flight simulators for aircraft 
research and development and for pilot training and proficiency 
maintenance. This fact, combined with the increasing 
sophistication and associated costs of available simulation 
devices, has raised the issues of the numerous trade-offs between 
simulation fidelity and costs to highly visible levels. In 
determining the simulation configuration required to meet certain 
goals, the concerned designer must consider the need for 
particular cueing devices as well as the requisite level of 
fidelity. For existing configurations, the simulation user 
should have some knowledge of the constraints placed upon the 
man-machine system performance (including performance/workload 
tradeoffs) by that level of simulation fidelity. 

For these reasons, NASA-LaRC has been engaged in a long 
range, parallel experimental and analytical program to develop 
data and methodology for evaluation and specification of 
simulator validity and fidelity. The experimental program has 
involved in-simulator experiments at the NASA-LaRC facilities to 
determine the effects on pilot/vehicle performance of digital 
computation and cueing hardware characteristics [1, 2], 

The analytic effort has involved development of a 
closed-loop model for a real-time digital simulation facility 
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[3] , which incorporates a multi— axis model for the human pilot. 
This simulation facility model allows simulator design trade-offs 
to be quantitatively evaluated. The model for the human pilot is 
a multi-cue version of the optimal control model [4-6] and the 
simulation facility portion includes the effects of plant 
discretization, computer iteration rate, interface conversion 
equipment (A-D and D-A) , and hardware system characteristics 
(e.g. visual delays, force-feel/control loading system, time 
lags, etc.). This model of a simulation facility, once tuned 
about the local conditions with data from an in-simulator 
experiment, can then be used to analyze both hardware and 
software design increments about these local conditions. 

Recent extensions of the model have provided for the 
dynamics of proprioceptive, kinesthetic, and vestibular cue 
generation equipment, as well as the informational contributions, 
ignoring any transformations imposed by the sensory organs 
involved [6], However, the motion sensing portion of the model 
has not been completely tested and in-simulator data has revealed 
some discrepancies between the data and the pre-experimental 
predictions of the untuned model [2], 

The work described in this report is part of an effort aimed 
at further development and validation of the analytic model as 
well as at obtaining a deeper understanding of the effects of 
simulation inadequacies on human pilots. The effort is both 
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analytical and empirical with the experimental effort involving 
both in-simulator experiments with various degrees of cueing 
(fixed base, platform motion, g-seat) and actual in-flight 
duplications of the same flight control task. The same pilots 
are used for simulator and flight experiments. The task involves 
an F 14 aircraft tracking a target aircraft that is executing a 
3g wind-up turn. Once steady state undisturbed tracking has been 
achieved, the reticle (sight) of the pursuing aircraft is 
disturbed by a random appearing signal. The simulator 
experiments duplicate this task under varying cueing conditions 
(fixed-base, g-seat, helmet loader, platform motion). These 
experiments provide an opportunity for direct comparison of 
simulator and flight results and should be an important step in 
the simulator validation process. The parallel analytic effort 
should result in an improved, validated closed-loop model and' in 
a greater understanding of how simulator deficiencies affect 
pilot performance and workload. 

Unfortunately, at the time this report was written, the 
experimental results had not been analyzed. Thus, the report is 
limited to a discussion of the analytic approach and preliminary 
model results; it is expected that later reports will present the 
experimental results and additional model analysis as well. 
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2. THE CLOSED-LOOP PILOT/SIMULATOR MODEL 


The closed-loop pilot simulator model is based on the 
Optimal Control Model (OCM) for the human operator. The OCM has 
been documented extensively [4-6] so, here, we will only review 
it very briefly. 

A detailed block diagram of both the system and the OCM 
pilot model is given in Figure 2.1. Note that the variables in 
this diagram are generally vectors so that we are modeling a 
multi-input, multi-output situation. The system portion (outside 
the dashed box) provides for representations of control stick 
dynamics, vehicle dynamics, and the dynamics associated with the 
simulator drive logic (e.g., a motion base washout filter) and 
its hardware (e.g., the servo drives). As shown, the two inputs 
to the system are the set of controls generated by the pilot, and 
the system disturbances which perturb the vehicle states. The 
set of system outputs is the cue set provided by the simulator to 
the pilot's various sensory systems. The OCM system modeling 
approach involves: a) a linearization of the relevant dynamics 
associated with each of the subsystems; and b) , the construction 
of a state-variable representation of the combined system 
dynamics. 

The state-variable system model includes dynamics associated 
with all of the subsystems comprising the simulator in addition 
to those associated with the aircraft itself and its control and 




FIG. 2.1 PILOT/SIMULATOR -MODEL 
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display systems. Furthermore, any dynamics (or state variables) 

needed to model command or disturbance inputs or to account for 

pilot sensory capabilities (e.g., vestibular dynamics) are 

* 

included in the formulation as part of this model. The 
inclusion of these various elements in the system model is 
significant because they will then be automatically reflected in 
the "internal model" of the pilot as represented in the OCM.- 
This is tantamount to assuming that the trained pilot will 
compensate for predictable correlations in the disturbance inputs 
and for his own sensory limitations, as well as for the 
particular (simulator) system being controlled. 

It is assumed that the information available to the pilot is 

that which he obtains via his visual, vestibular, proprioceptive 

and tactile sensory systems. The individual display vectors 

associated with a particular modality can include information 

provided by more than one cueing system which impinge on that 

same modality. Thus, for example, y can include both 

vis 

out-the-window (visual) cues and additionally available 
instrument (visual) cues. 


* 

Of course, engineering judgement or more formal analyses will 
frequently be used to simplify the model significantly. For 
example, if signal frequency content is well within the bandwidth 
of a system, the dynamics of that system may be ignored; this is 
often the case for vestibular dynamics. Such simplifications are 
very useful in reducing computational costs in applying the OCM 
and were applied to this problem for the analysis discussed 
later. 
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The pilot cannot attend to all sources of information 

simultaneously and must, therefore, selectively allocate his 

attention. A model for attention-sharing has been developed and 

incorporated in the OCM to provide a basis for predicting the 

effects of attention-sharing on performance [7]. The "monitor" 

block of Figure 2.1 represents the attention selection portion of 

the model, i.e., the mechanism for choosing the fraction of 

attention f associated with the ith display variable. (In the 
i 

steady-state analyses we are conducting, we use the overall or 
average fractions of attention rather than a moment- to-moment 
allocation). We assume here that the pilot need not share 
attention between different sensory modalities; e.g., that 
processing of, say, motion cues does not interfere with the 

processing of visual cues. This is a plausible assumption but it 
has not been validated experimentally; to the extent that the 
assumption is violated, model results would tend to be somewhat 
optimistic in predicting the benefits of motion cues. However, 
attention may have to be shared among the display variables 
within a particular sensory modality. This is certainly true for 

the visual modality and could possibly be the case for other 

modalities. There are two basic approaches to picking the 
attention levels; either they are computed to optimize 

performance or, more simply, they are picked by assumption. When 
the attentions are picked by assumption, it is most frequently 
assumed that the pilot devotes equal attention to each display; 
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the attention fraction in that case is the reciprocal of the 
number of displays. 

Additional pilot limitations on the processing of 
information are accounted for by the time delay and observation 
noise shown in Figure 2.1. The time delay, r , is a lumped 
representation of the various internal delays associated with 
visual, vestibular, central processing and neuro-motor pathways 
(typically, 200ms±50ms) . Observation noise, y , is included to 

y 

account for the pilot's inherent randomness due to random 

perturbations in human response characteristics and errors in 

observing displayed variables. A validated model for choosing 

* 

observation noise covariances exists [4,7,8]. 

The optimal estimator, predictor and feedback gain matrix 
represent the set of "adjustments" or "adaptations" by which the 
pilot tries to optimize his behavior. The general expressions 
for these model elements are determined by system dynamics and 
task objectives according to well-defined mathematical rules (5). 
The controller is assumed to adopt a response strategy to 
minimize a cost that is a weighted sum of averaged output and 
control variances. The most commonly used method for selecting 


* 

The model for attention-sharing is used to modify the basic 
observation noise covariances — the less attention devoted to a 
variable, the higher the corresponding observation noise. 
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reasonable a priori estimates for the cost weightings is to set 

them equal to the reciprocal of the square root of an "allowable" 

limit or deviation from nominal in the corresponding system 

variable; this approach has been described in several recent 

applications of the OCM (see, for example, [9]. The control-rate 

related weightings may be chosen in a similar fashion or, as is 

usually the case, they may be picked to yield a desired values 

for the neuromotor lag matrix, l (see Figure 2.1 and below). 

N 

Finally, response limitations on the pilot's ability to 

execute appropriate control actions and to have perfect knowledge 

of those actions are accounted for in the motor model, which is 

comprised of the first-order lag matrix 1 and a white motor 

N 

noise source. 


3. MODEL FORMULATION OF TASK 

As noted earlier, the basic flight task investigated 
involved an F-14 tracking a target (T-38) aircraft executing a 3g 
wind-up turn. For this analysis, tracking was to occur at a 
constant altitude of 10,000 ft. and a constant airspeed of 350 
Kts . Steady-state tracking was desired so the chase aircraft was 
instructed to maintain a constant range (~800') f as well as 
altitude and airspeed. The pitch, roll and yaw SAS's of the F-14 
were operational for the task. The gunsight was displayed on a 
programmable HUD which was modified to allow the reticle to be 
driven in elevation by a signal consisting of a sum-of-thirteen 
sine waves with random initial phasing. The power in the sine 
waves was chosen so that the discrete spectrum of this signal was 
an approximation to the continuous spectrum that would obtain 
from passing white noise through a second order filter (with 
poles at 0.25 r/s and 0.5 r/s) . The pilot "tracked" by keeping 
the reticle on the target. 

The analytic description of this task involves a very high 
order state-variable formulation; without any approximations, the 
implementation of the augmented (i.e., including SAS) F-14 
vehicle dynamics requires 24 state variables, and eight 
additional state variables are needed for the display of target 
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* 

position. There are four possible pilot control inputs 
(including the throttle for speed control). , A problem of this 
magnitude represents a significant computational burden in the 
OCM context that will assume even greater import when model 
results are to be matched or tuned with data, as will be required 
later. 

In order to minimize the potential computational costs and 
problems, efforts were made to reduce the size of the system 
model without compromising the fidelity of the model response. 
The specific simplifications made, and their justification, are 
discussed in some detail below. Briefly, system model 
simplification proceeded in the following stages. First, the LOS 
equations given in Appendix A were simplified. Then, the 
control/stability augmentation system was greatly reduced. 
Finally, additional simplifications were made for obtaining 
closed-loop predictions with the OCM. This led to a 16-state, 
two-control model ultimately being used for predicting 
pilot/vehicle performance. This reduction in system complexity 
leads to very substantial computational savings. The reduced 
order equations are given in Appendix C. 


* 

The display or line-of-sight (LOS) equations are given in 
Appendix A, target kinematics are derived in Appendix B, and 
system state equations are given in Appendix C. 


3-2 



Initial exploration with the BBN model response indicated 
that the LOS equations (see Appendix A) could be simplified 
without materially affecting model response. For the model tests 
described here, and for all subsequent model applications, the 
target u-state, and the LOS-related 0- and 0-states were 
eliminated from the state— variable representation. Furthermore, 
the Euler 0-state was used in computing LOS error, rather than 
the "local” ©-state as defined in the Appendix. 

This (partially) reduced-order model was verified through a 
comparison of the open-loop transient resonses of the analytic 
and simulation models. In order to provide a transient response 
that would exhibit some of the variational behavior typical of 
closed-loop tracking and that would avoid the build-up of very 
large "errors", pitch and roll triplets were used as inputs. The 

6 and 6 trajectories used in this verification are shown in 
e a 

p p 

Table 3.1. (Variables of the form 6 represent "pilot" inputs 

ep 

to the augmented vehicle — — not control surface deflections. ) 

Near-perfect matches to responses of the vehicle states were 
achieved by the BBN computer model. Sample tracings of model 
(smooth curve) and simulator (discrete points) responses are 

given in Figure 3.1 for pitch rate and in Figure 3.2 for yaw 

rate. Responses to other state variables were matched equally 


3-3 


TABLE 3.1 TRIPLET INPUTS USED IN COMPUTER MODEL VERIFICATION 


Time 

6 

6 




e 

a 



(sec) 

(in) 

(in) 



1.0 

0.4 

0.25 



2.0 

-1.2 

0.75 



3.0 

1.2 

-0.75 



4.0 

-0.4 

' 0.25 



well. 

In these and ensuing figures, "simulator" 

refers to 

the 

LaRC nonlinear 

simulation model, and "model" refers 

to the 

BBN 

linear 

analytic 

model . 




Figures 3.3 and 3.4 show good correspondence between model 

and simulator LOS errors, for the first 5 seconds following input 

initiation, for the "on-axis" errors (i.e., response of elevation 

efror to <5 , and response of azimuth error to fi ) . The responses 
e a 

of azimuth error to 6 correspond over a smaller range — about 2 

e 

to 3 seconds following onset of the input. Least well matched is 

the response of the elevation error to the 6 input. The 

a 

off-axis responses are relatively small compared to the on-axis 
responses, however. Overall, the transient response of the BBN 
model is sufficiently close to that of the LaRC simulation to 
warrant its use in prediction of closed-loop performance trends. 
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Figure 3.1. Comparison of Model Pitch-Rate Response to 
Simulator Response 
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Figure 3.2. Comparison of Model Yaw-Rate Response to 
Simulator Response 
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a) 6 Input 
ep 



Figure 3.3. Comparison of Model LOS Response in Elevation 
to Simulator Response 
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Order Red uction of the Control systPm 


Various factors facilitated order-reduction of the F-14 
control/stability augmentation system for purposes of pilot- 
vehicle performance analysis. First, a number of system elements 
were simple lags with relatively short time constants (and 
therefore little effect on vehicle response over the region of 
man/machine response bandwidth) . Second, some redundancies 
existed in the original definition of control system state 
variables. Third, other state variables were not excited by the 
inputs expected in the particular problem under study. Finally, 
the control system structure was decoupled along the various 
control axes; this factor allowed us to explore the input/output 
behavior of the control system individually in each control axis. 

Bode plots were computed relating each control-system output 
to each control -system input, and low-order matches to these bode 
plots were obtained by gradient search procedures. The 
reduced-order system eventually adopted contained three state 
variables (instead of sixteen) to represent a washout in the 
pitch-rate control loop, a lag-lead network in the roll-rate 
control loop, and a washout in the yaw-rate control loop. Engine 
dynamics and control were represented by a pure-gain 
feedback/feedforward network. 

Figures 3.5 and 3.6 compare the elevation and azimuth LOS 
error transient responses of the augmented vehicle using the 
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full-state and 3-state augmentation systems. The input, 
trajectories defined in Table 3.1 were used for this comparison. 
This analysis was performed with the BBN analytic model, with the 
LOS equations simplified as described above. The transient 
responses of the two model formulations were in very good 
agreement. 

Whereas these transient responses allow the reader to 

compare relatively long-term response behaviors, a comparison of 

short-term response characteristics of the two model formulations 

can be inferred from the high-frequency portions of the Bode 

plots shown in Figures 3.7 and 3.8. Four Bode plots are shown, 

relating azimuth and elevation LOS errors to 6 and 6 inputs. 

e a 

The two model formulations yielded Bode plots that were 
nearly identical except for high-frequency phase differences 
found in three of the transfers. in all three cases, the 
reduced-order system showed less high-frequency phase lag than 
the full-order system. To compensate for this in computing 
closed-loop performance, a pure time delay was included in the 

system description to provide additional high frequency phase 
lag. 

Other simplif icatinnR gf system Model 

The problem formulation was further simplified by assuming 
that the pilot could maintain constant range and that variations 
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a) <5 ep Input 



TIME (seconds) 

Figure 3.5. Comparison of the Elevation LOS Error Transient 
Responses of the Full-State and 3-State 
Augmentation Systems 
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Figure 3.6. Comparison of the Azimuth LOS Error Transient 
Responses of the Full-State and 3-State 
Augmentation Systems 




Ctrl Sys 



TIME (seconds) 


Figure 3.6. (Concluded) 



PHASE(deg) GAIN (dB) 


a > ' ,/{ ep 



FREQUENCY(rad/sec) 


Figure 3.7. Bode Plots Relating Elevation LOS Error to 
Pilot Control Input 
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Figure 3.8. Bode Plots Relating Azimuth LOS Error to 
Pilot Control Input 







from nominal airspeed could be neglected. It was also found that 
the number of controls could be reduced to two by assuming 
constant (equilibrium) thrust and rudder deflection. The effects 
of these simplifications on predictions of closed-loop 
performance are discussed in Chapter 4. Finally, for purposes of 
this preliminary model analysis, human vestibular dynamics were 
ignored and simulator dynamics were approximated by pure delays. 
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4. RESULTS AND DISCUSSION 


The Optimal Control Model (OCM) was employed prior to the 
simulation experiments to generate predictions of closed-loop 
system performance and pilot response behavior. Of particular 
interest for this analysis were predictions of performance trends 
concerning the effects (or lack thereof) of the motion- and 
visual-cueing devices to be explored in the simulation study. 

In order to obtain model predictions it was necessary to 
specify four categories of independent ("pilot-related") model 
parameters: (a) "cost" coefficients, representing the pilot's 
perception of control-task requirements; (b) observation noise 
variables, reflecting attentional and perceptual limitations, as 
well as limits on the pilot's ability to generate noise-free 
responses; (c) a time delay reflecting various sources of 
perceptual, central processing, and execution delays; and (d) a 
motor noise/signal ratio to account for limits on the pilot's 
knowledge of vehicle response behavior. 

Cost coefficients were determined by first specifying 
desired "limits" (maximum allowable errors) on important control 
and response variables, and then setting each quadratic cost 
coefficient equal to the square of the reciprocal of its 
corresponding limit. Limits (and therefore "costs") were 
associated with. LOS and airspeed errors, control deviations from 
trim, and rate-of -change of control (the latter required by the 
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particular mathematical formulation of the OCM) . By assigning 
zero costs to deviations in other variables, such as attitude 
changes, the flight task was modeled as a two-variable tracking 
task. . 

The pilot was assumed to adopt the radius of the reticle (50 
o 

mils, or 2.87 ) as the maximum allowable LOS error. Other 
limits, and associated cost coefficients, are shown in Table 4.1. 
.Cost coefficients for control-rate variables were not set on the 
basis of assumed limits, but rather on the basis of pilot 
bandwidth considerations. . These coefficients were selected in an 
iterative fashion to yield "motor time constants" of 0.1 seconds 
for longitudinal and lateral stick inputs, and 0.2 seconds for 
rudder and throttle inputs. 

Three types of observation noise variables were selected. 
First, ah overall noise/signal ratio was selected as a "free" 
parameter of the analysis to reflect overall attention to the 
flight task [6,7]. Second, noise parameters reflecting a 
statistical treatment of perceptual "threshold" effects were 
associated with each display variable used by the pilot. 
Finally, a specific allocation of attention among these display 
variables was assumed. . 

The pilot was assumed to use LOS error' information (both 

• • < 

displacement and rate) , as well as airspeed information. 

o 

"Indifference thresholds" of 1 tick mark (10 mils or 0.57 ) were 



TABLE 4.1 INITIAL SELECTION OF PILOT MODEL PARAMETERS 




Cost 



Variables 

Limit 

Coefficient 

Threshold 

Attention 


Display Variables 


y e (deg) 

2.87 

0.12 

0.57 

0.45 

(deg/sec) 


0 

0.2 

0.45 

A e (deg) 

2. 87 

0.12 

0.57 

0.45 

• ; 

x e (deg/sec) 

— 

0 

0.2 

0.45 

^ (ft/sec) 

10 

0.01 

3.4 

0.10 


Control Variables 


^ (in) 

ep 

• 

4 

0.63' 

6 ep (in/sec) 

* 

* 

{ ap < in > 

• 

3.5 

.082 

(in/sec) 

ap 

* 

* 

6 (in) 

# rp 

3.0 

0.11, 

6 rp (in/sec) 

* 

* 

6 t (%) 

• 

0.5 

4.0 

6 T (%/sec) 

* 

* 


*Control-rate cost coefficients chosen to yield motor 
time constants of 0.1 for 6 and 6 , and 0.2 for 

4_ and ep ap 

■P ^ 
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associated with the use of LOS error information, and visual 
thresholds of 0.2 deg/sec were assumed f Or LOS error rates. An 
indifference threshold of 2kt = 3.4 ft/sec was assumed for 

airspeed regulation. The pilot was assumed to allocate 45% of 
his available attention to elevation LOS error and error-rate, 
collectively? another 45% to azimuth LOS error and error rate; 
and the remaining 10% to airspeed, primarily for cross-checking 
purposes. 

Cost coefficients and perceptual parameters are shown in 
Table 4.1. In addition, a baseline observation noise/signal 
ratio of -20dB was selected to reflect a situation of 
moderate-to-high attentional workload; the time delay was set to 
0.32 to reflect the combined effects of inherent operator delay 
(0.2 sec) , sample-and-hold operations in generating the visual 
display (.05 sec), and corrections to the reduced-order augmented 
vehicle model (.07 sec); and the motor noise/signal ratio was set 
to -60 dB. 

Preliminary model analysis was performed to determine the 

extent to which the problem formulation could be further 

simplified by reducing the number of active controls, and by 

eliminating the airspeed state, without compromising the 

reliability of the model predictions. Three sets of model 

results were obtained using the relevant parameter settings of 

Table 4.1: (1) 6 , 6 , and <5 active, with airspeed included; 

ep ap t 
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(2) 6 and 6 active, with airspeed omitted; and (3) 6 and 

ep ap ep 

6 active with airspeed omitted. (Numerical difficulties 
rp 

prevented a model solution with all four controls active.) 


These model variations resulted in a spread of less than 10% 

in each of the predicted LOS error and error-rate variables and 

in the 6 control variable. We therefore felt that predictions 
ep 

of performance trends would not be compromised by the selection 

of one of the simpler model formulations. The configuration with 

the 6 and 6 controls, and without the airspeed state, was 
ep ap 

used for the remaining pre-experiment model analysis. 


The 

effects of 

* 

model 

parameter manipulations 

on standard 

deviation 

(SD) scores 

were 

then predicted. 

For 

economy of 

notation, 

we def ine 

the 

terms "elevation 

error" 

to mean the 

elevation 

component of 

the line-of-sight error 

, "azimuth error" 


to mean the azimuth component of the line-of-sight error, and 


"LOS error" as the vector line-of-sight error. Thus, 
2 2 1/2 


LOS 


* < % + °x> 


The baseline model configuration was defined using the 
parameters shown in Table 4.1 with the following exceptions: (1) 
no rudder and throttle controls, (2) no speed state, and (3) 


* 

The steady-state implementation of the OCM used in this study 
considers all variables as zero-mean processes. Thus, only the 
variational (SD) statistics of the time histories are predicted. 
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relative attentions of 0.5 each to azimuth and elevation LOS 
error. Predicted standard deviation (SD) scores for this 
configuration are shown in Table 4.2. Note that the azimuth 
error is the same order of magnitude as the elevation error, even 
though the external forcing function (pipper disturbance) is 
applied only to the elevation component. This result reflects 
two factors: (1) the coupling between elevation and azimuth in 
the system equations of motion for the high-bank attitude, and 
(2) the indifference threshold assigned to azimuth and elevation 
errors, which turned out to be about the same as the predicted 
elevation SD score) . (Because threshold effects are represented 
stochastically by observation noise components, rather than 
deterministically by nonlinear response elements, the predicted 
SD score can be less than the assumed threshold, as was the case 
for the predicted azimuth score). 

TABLE 4.2 PREDICTED SD SCORES FOR BASELINE CONFIGURATION 

Predicted Score 
0.69 

0.58 

0.38 

0.21 

0.13 


Variable 

a 

LOS 


>ep 


6ap 
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The assumed split of attention between elevation and azimuth 
error components was varied in order to determine the sensitivity 
of the predicted (vector) LOS error to attentional allocation. 
Figure 4.1 shows that, while the individual error components were 
sensitive to attention, they tended to vary in a compensating 
manner, with the result that the total (vector) LOS error was 
relatively insensitive to attention in the region of optimal 
attention-sharing. In particular, the baseline assumption of 
equal attention to azimuth and elevation errors yielded a LOS 
error score within 5% of the score obtained with optimal 
allocation. Since we had no basis for predicting how elevation 
and azimuth errors would be traded off within the band of 
insensitivity, the assumption of equal attention-sharing was 
retained for subsequent model analysis. 

Sensitivity analysis was performed with respect to each of 
the following independent model parameters: (1) observation 
noise/signal ratio, (2) motor noise/signal ratio, and (3) time 
delay. This analysis was performed primarily to determine how 
critically the model predictions depend on the particular 
selection of parameter values. Because observation noise/signal 
ratio has been identified with attention [7] , the relation 
between performance and this parameter has the additional 
interpretation of a performance/workload tradeoff. 

Figure 2.2 shows that a 6dB increase in observation noise 
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(which we interpret as a 75% reduction in attention) caused the 
predicted LOS error score to approximately double. This 
sensitivity is greater than that typically predicted for either 
laboratory tracking or simulated flight tasks [9-11] . If, as 
suggested by Wewerinke [9], we consider workload to be related to 
the sensitivity of performance to observation noise, as well as 
to the average noise level at which the pilot operates, the 
curves of Figure 4.2 suggest that we are dealing with a 
relatively high-workload task. 

By way of contrast, Figure 4.3 shows that predicted LOS 
error score is relatively insensitive to motor noise/signal ratio 
over the range explored. Thus, selection of this parameter, is 
not critical, provided we stay in the range typical of previous 
studies (between -50 and -60dB) . 

Sensitivity of performance with respect to time delay was 
explored, in part, to determine the potential effects of 
simulator delays. The time delay parameter was varied over a 
range of 270 to 370 milliseconds, where 270 msec represents a 
basic operator delay of 200 msec plus 70 msec to account for 
model simplifications, but no simulator delays. Figure 4.4 shows 
that predicted LOS error was relatively insensitive to time 
delay, varying by less than 15% over the range explored. These 
model results suggest that delays associated with generating 
visual and motion cues (provided they are less than 100 msec) 




OBS NOISE/SIGNAL RATIO (dB) 


Figure 4.2. 


Effect of Observation Noise/Signal Ratio 
on Predicted Error Scores 



ERROR SD SCORE (degrees) 




ERROR SD SCORE (degrees) 



0.22 0.27 0.32 0.37 0.42 

TIME DELAY (seconds) 


Figure 4.4. Effect of Time Delay on Predicted Error 
Score 
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should have little influence on the outcome of the experimental 
study. 

We should note that previous comparisons of model and 
experimental data indicate that the model may tend to yield 
optimistic performance predictions when control-loop delays are 
large. Thus, the sensitivity of actual pilot/vehicle performance 
to loop delays — especially for delays on the order of 200 msec 
and more — may be greater than that indicated by Figure 4.4. 

Potential effects of motion cueing were predicted on the 
basis of "best-case" assumptions. Specifically, we assumed that 
platform motion would provide attitude, attitude-rate, and 
lateral acceleration cues with no attention-sharing penalties, 
and that perceptual threshold effects for these motion cues would 
be negligible. Similarly, the g-seat and helmet loader were 
assumed to provide z-axis acceleration with no degradation. To 
model the condition with both types of non-visual motion cues 
present, we adjusted parameters as before and augmented the 
display vector with all three attitude-rate variables, all three 
attitude-acceleration variables, along with a and n ; and we 

y z 

assigned unity attentions to all such motion cues. 

Performance/workload predictions for the baseline ("visual") 
case and the visual-motion ("motion") case just described are 
compared in Figure 4.5. The predicted benefits of non-visual 
motion cueing are minimal — less than a 10% improvement in LOS 
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error at high workload (-20dB observation noise) , with this small 
difference disappearing as observation noise increases. 

These predicted trends agree with experimental studies which 
show that motion cues are most effective when the external 

l 

forcing function acts directly on the simulated vehicle, and 
least effective when the external disturbance consists of target 
maneuvering. [12], These results are also plausible on the basis 
of a theoretical informational analysis. When the disturbance is 
applied directly to the vehicle (as, say, a simulated gust 
disturbance) , whole-body and g-seat motion cueing provide the 
(mathematical) "pilot" directly with vehicle acceleration cues 
that would not be so readily available from visual cues alone. 
When there is no external vehicle disturbance, however, vehicle 
motions are entirely in response to the pilot's control input. 
In this. case, no new information is provided by non-visual motion 
cueing, and no performance improvement should be expected. The 
small performance effects shown in Figure 4.5 arise from the 
inclusion of the motor noise in the model, which prevents the 
"pilot" from having perfect knowledge of the control input 
applied to the vehicle. 

Arguments can be offered both as to why motion-cue effects 
should be greater in the simulator (or in flight) than predicted 
by the model, and why such effects should be less than predicted. 
On the one hand, we have made very optimistic assumptions 



ERROR SD SCORE (degrees) 



Figure 4.5. Effect of Cueing Environment on Predicted 
Performance/Workload Tradeoff 
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concerning the quality of the motion cues received, ignoring 
perceptual threshold effects, vestibular sensor dynamics, and 
potential attention-sharing penalties regarding the concurrent 
use of multiple motion and visual cues. Consideration of these 
factors would further decrease the visual/raotion differences 
shown in Figure 4.5. 

On the other hand, we have made optimistic assumptions 
concerning the pilot's state of knowledge: namely, that he is 

trained to the point where he has a near-perfect "internal model" 
of the vehicle dynamics. To the extent that the pilot is not 
trained (or trainable) to this state, we expect that 

visual/motion differences will be greater than predicted, because 
the motion cues will likely enhance the pilot's ability to 
construct and maintain an accurate internal plant model [13]. \ 

There is some circumstantial, but consistent, evidence to 
suggest that the accuracy of the pilot's internal model is 
degraded by insufficient training and/or by the presence of large 
delays and/or high-order response dynamics in the control loop 
[13] . The extension of existing pilot models to be able to 
predict the effects of training and task environment on the 
pilot's internal model remains as an interesting area of future 
research. 

Recall that the results presented so far were obtained with 
perceptual "thresholds" selected on the basis of presumed minimum 
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allowable error ("indifference thresholds") rather than visual 
resolution limitations. To determine the extent to which 
predicted 1 ine-of-sight errors were tied directly to these 
threshold parameters, the baseline condition was reanalyzed with 
parameters adjusted on the basis of visual resolution limitations 
based on previous tracking results [8]. Thresholds of 0.05 arc 
degrees were associated with perception of elevation and azimuth 
error, and rate thresholds were again assumed to be 0.2 deg/sec. 

Figure 4.6 shows a substantial reduction in the predicted 
azimuth error — about 50% of the rms error predicted with 
indifference thresholds. The elevation error was reduced by 
about 30%, and the vector LOS error by about 40%. Clearly, the 
predicted azimuth error in the baseline case is determined 
primarily by the selection of a threshold value; this is not 
surprising, given the lack of a forcing function in the azimuth 
axis and the relatively low cross-axis coupling provided by 
system dynamics. The elevation error is less directly dependent 
on the associated threshold (except for very large thresholds) ; 
the predicted error in Figure 4.6 is on the order of 10 times the 
assumed threshold. 
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Figure 4.6. Predicted Performance/Workload Tradeoff 
with Visual Thresholds 
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5. CONCLUDING REMARKS 


The above results represent a preliminary analysis. The 
most significant portion of our efforts remains; namely, the 
comparison of model results with the empirical data. 
Experimental measures and model predictions will include both 
time domain system performance measures (SD performance scores) 
and frequency domain measures of pilot-related quantities 
(describing functions and remnant spectra). Our strategy will be 
to "tune" the model to each simulator experimental condition by 
identifying model parameters (time delay, noises, etc.) that 
provide the "best” match to the data [14], These parameters, 
which will also reflect the individual characteristics of the 
subject pool for the experiment, will then be used to predict 
results for the flight experiment. Again, model/data comparisons 
will be made and parameters yielding a best. match to the flight 
data determined. Discrepancies between simulator and flight data 
will be explored, using the model, to provide analytical bases 
for the differences in terms of cueing deficiencies and/or 
changes in pilot strategies and to further upgrade and develop 
the analytical models. 
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APPENDIX A 

LINEARIZED LINE-OF-SIGHT ERROR EQUATIONS 


The elevation line-of-sight (LOS) error, U f and the azimuth 
LOS error, A , are defined as follows: 

Z(t) - z n (t) 

u ( t ) = ± 

D ( t) 

Y (t) - Y(t) 

A(t) = -i— 

D ( t) 

where D(t) = x T (t)-X(t), and where the subscript "T" indicates 
the position or velocity of the target aircraft in the pursuer's 
body axis coordinate system. With this sign convention — which 
is consistent with the sign convention adopted in the LaRC 
simulation — positive LOS error occurs when the target is 
located above and/or to the right of the projected pursuer's body 
axis. (Note that positive Z is down.) 

Through geometric analysis one arrives at the following 
expressions for the rate of change of LOS error: 

P = D (U-U T ) + 5 (W“W T ) - Q + PA 
X = 5 (U-U T ) - 5 (V-V T ) - r - Pu 
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If we consider each problem variable to be the sum of steady- 
state and perturbation terms (e.g., U = U Q + u) , we arrive at the 
following expressions for the perturbation in LOS error about the 
nominal : 

. M i 

y = D 1 (lJ-y T ) + D" (w_( V + X 0 p 
o o 

-q+P Q X +pX + £- (U-M T ) 

o 

S" (v “ V = y o P 

o 

pu + (y-u T ) 

The final two terms of each of the above expression 
represent nonlinearities which, for small perturbations, are not 
expected to contribute significantly to the LOS error and which 
will be ignored in the remaining analysis. 




APPENDIX B 
TARGET KINEMATICS 


Note that the equations for LOS error include terms relating 
to the apparent motion of the target in the pursuer's coordinate 
frame. In this Appendix we derive the linearized state-variable 
equations for apparent target motion. 


We consider target motion in three different coordinate 

frames: 5£ , the target motion in the (rotating) target 

TT 

coordinate frame, 5£ , target motion in some inertial coordinate 

TI 

frame; and 3Z. , the apparent target motion as seen from the 

TP 

pursuer's (rotating) coordinate frame. Let the translational 
target velocity components U, V, and w be represented 
collectively by the vector 5£. 


Let A be the transformation from inertial to pursuer 
T 

coordinates, and let A be the transformation from inertial to 

P 

pursuer coordinates. Thus: 


-1 



= A 

V 

= A'3£ 

TI 

T 

TT 

T TT 

5£ 

= A 


It 

K 

TP 

P 

TI 

P T TT 


where the prime (') indicates matrix transpose. 

Since, for this problem, the target flies a constant 
circular path, the acceleration of the target in its own 
coordinate system is zero, and 



(B. 2) 


—TP — t— P &'t ^P^'t^TT 

Note that 

A = - 5 £ 

A' = 5* = +&'fl 



Equation A3 may thus be written as: 

Vipp = [“ ^p ^rp + ilp&ip 2.fp]Vipip (B. 4) 

Because of the coupling between translational and rotational 
motions, that apparent translational acceleration Ypp will 
generally be nonzero even though the target has no translational 
acceleration in its own coordinate frame. 

It is convenient to define the inertial coordinate frame as 
that which overlaps the nominal (i.e., error-free) pursuer 
coordinate frame at a given time. That is, we take a "snapshot" 
of the tracking task, align the inertial coordinate frame with 
the desired position and orientation of the pursuer at that 
instant, then let the task proceed with the inertial frame fixed 
in space. 
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instant, then let the task proceed with the inertial frame fixed 
in space. 

We next define certain problem variables as the sum of their 
nominal and small-signal-incremental values: 

n = n 

T O 

^ -I- co 

P o 

A = i + aa (b.5) 

p p 

JZ = 3Z + y 
TP TP TP 

o 

where fl is the nominal rotation rate of both the target and 
o 

pursuer. (For this problem, target rotation remains at nominal). 
From equations B.4 and B.5 we obtain 


i + i 

TP TP 

o 

I (” £ + 111) (I + AA ) A' + (I + AA )A' R ]V (B.6) 

O P T P T O TT 

o 


Since steady-state accelerations are zero, jjr =0, and 

TP 

a A' 2 = A' ft 3Z (B. 7) 

O T TT T O TT 

O O 
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of the pursuer. This acceleration would be apparent even in the 
case of a straight-and-level tracking task. The terms containing 
A^p account for apparent translational acceleration due to an 
off-nominal orientation of the pursuer. This effect scales with 
the nominal rotation and is therefore zero in a straight-and- 
level task. 


By assuming small deviations of the pursuer’s orientation 
from nominal, we obtain: 



O ip 

-\p 0 


where jzS = ; p, 0= ; q,4> =/r 


9 

o 


(B. 9) 


Except for nominally straight-and-level tasks, the short-term 
integrations indicated above will, in general, be different from 
the Euler angles — in the case of a high-g turn, substantially 
different. 1 


From Equations B.3, B.8, and B.9, we obtain the following 
state-variable equation for the incremental target acceleration 
as seen in the pursuer's coordinate system: 
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p 


w 


E-» 

1 


0 

-w mT 

TlO 

V TIo 

(Q o V TIo +R o W TIo» 

- P o V TIo 

P W mT 
o TIo 

^TP 

= 

W TIo 

0 

- U TIO 

- Q o U TIo 

(P o U TIO +R o W TIo> 

^o W TIo 

W TP 


-\lo 

U TIo 

0 

"Vtio 

- R o V TIo 

(P O U TlO +0 O V TIO ) 


'i 

r 

0 

& 

•!> 


(B. 10) 


The results shown in Equation B.10 have been simplified by 
the particular problem considered in this study, and by our 
selection of an inertial reference frame. If one were to 
consider non-steady-state target motion, this expression would 
have to include the effects of target rotational states. For 
another choice of inertial reference frame (say, an earth-based 
reference), the nominal translational velocities Um T , etc.) 
would be replaced by U T p^, etc. (For the treatment shown here, 


Y T i 


o 



The numerical values selected for Y TI in a specific problem 

u o 

depend on the nominal difference in orientation between target 
and pursuer. For the particular problem explored in this study, 
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in a specific problem 


The numerical values selected for 

TI 

o 

depend on the nominal difference in orientation between target 

and pursuer. For the particular problem explored in this study, 

in which the target and nominal pursuer orientations differ only 

in (earth-based) heading, it is convenient to transform target 

coordinates to earth-based coordinates and then transform from 

earth to nominal pursuer coordinates. The parameters used in 

carrying out this transformation, and the resulting vector 

velocity y , are given in Table B.l. 

TP 

o 
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TABLE B.l TRANSFORMATION FROM TARGET TO PURSUER COORDINATES 


Nominal Orientation: 


m 

11 

O 

'a 

-1.23 rad 


e o = 

6.21 E-3 rad 


Wo = 

0.159 rad 


Target Velocity Vector in Target Coordinates: 


U TT 

686 

ft/sec 

o 

V = 

TT 

5.59 

ft/sec 

O 

w„„ = 

TT o 

53.6 

ft/sec 


Target Velocity Vector in Nominal Pursuer Coordinates: 

U TI = ft/sec 

o 

V TI = -30.9 ft/sec 
o 

W TI = -49.4 ft/sec 
o 
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APPENDIX C 

SYSTEM STATE EQUATIONS 


The state-variable equations for the augmented F-14 
dynamics, including 1 ine-of-sight (LOS) equations and target 
kinematics, are presented. The state variable description has 
the form 

X = AX + Bu + Ew 
¥ = £x + DU 

where the vectors x, y, and w. represent system state 

variables, system output (or display) variables, pilot control 
inputs, and external driving noise processes. 

All equations shown here reflect a linearized model of 
small-signal deviations about trim conditions. 

C.l Fully-Augmented Aircraft 

i 

System dynamics for the fully-augmented F-14 are shown in 
Figure C.l. Numerical entries for matrices A,B,C, and D are 
shown, along with a list of system eigenvalues. Effects of 
pipper motion, which would be represented by the E matrix, are 
not given here. No external disturbances, other than pilot 
inputs, were assumed to act on the airplane in this formulation. 


C-l 



To enhance interpretation of the numerical entries, the 
description of each system matrix includes text information to 
identify the system variables associated with rows and columns. 
For example, the row identifiers for the B matrix define system 
state variables, and the column identifiers define pilot control 
inputs. 

The first eight state variables are standard aircraft 
response variables as defined in the List of Symbols, the "alt" 
state represents height deviation from nominal, and variables zl 
through zl5 are state variables introduced by the augmentation 
system. The "engine" state represents a first-order lag model of 
engine response dynamics, "vt" and "wt" are target lateral and 
vertical motion as seen in the pursuer's coordinate system, and 
lamda and mu are azimuth and elevation line-of-sight errors. 

Many of the state variables also serve as output variables. 

In addition, the output vector includes acceleration components 

a and a , the four aircraft control input (control surfaces, not 
z y 

pilot inputs) , and LOS rates of change. The control vector 
contains the four pilot inputs. 

All aircraft translational variables have units of feet, 

angle variables (including control surfaces) are in radians, and 

pilot inputs are in inches of control deflection for 6 , 6 t 

ap ep 

and 6 , and fraction of maximum input for 6 

rp tp 
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DYNAMICS FOR FOLLY-AUGMENTED AIRCRAFT 


A 

MATRIX: 



u 

V 


r 

theta 


z2 

z3 


z 14 

z8 


z 10 

z 1 2 


wt 

1 ambda 

u 

-3.750E-02 

-4.860E-02 


5 . 590E+00 

-3.220E+01 


0 . 

0 . 


6 . 440E-02 

0 . 


0 . 

0 . 


0 . 

0 . 

V 

3 . 260E-02 

-2.000E-01 


—6 . 820E+02 

1 .890E-01 


0 . 

0 . 


0 . 

0 . 


0 . 

0 . 


0 . 

0 . 

w 

-4 . 500E-02 

-5.510E-02 


0 . 

—6 . 670E-02 


0 . 

0 . 


—9 . 790E— 01 

0 . 


0 . 

0 . 


0 . 

0 . 

p 

-3 . O0OE-Q5 

-3.090E-02 


5 . 300E-01 

0 . 


0 . 

0 . 


0 . 

0 . 


0 . 

0 . 


0 . 

0 . 

q 

1 .950E-03 

—4 . 800E-04 


1 .480E-03 

0 . 


0 . 

0 . 


-9.790E-02 

0 . 


0 . 

0 . 


0 . 

0 . 

r 

-1 . 050E-04 

7 . 46QE-03 


—3 . 050E-01 

0 . 


0 . 

0 . 


0 . 

0 . 


0 . 

0 . 


0 . 

0 . 

theta 

0 . 

0 . 


9.430E-01 

0 . 


0 . 

0 . 


0 . 

0 . 


0 . 

0 . 


0 . 

0 . 


w 

p 

q 

phi 

al t 

zl 

z4 

z5 

z6 

z9 

z 1 5 

zll 

zl3 

engine 

vt 

mu 



-3.220E-02 

0. 

—5 . 220E+01 

0. 

-1 .380E-05 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

6. 130E-04 

0. 

0. 



9 , 270E-03 

5 . 500E+01 

0. 

1 . 070E+0 1 

-3 . 420E-05 

0. 

0. 

0. 

0. 

0. 

1 .610E-01 

0. 

7 . 080E-01 
0. 

0. 

0. 

-1 .210E+00 

—5 . 590E+00 

6 . 77QE+02 

3 . 040E+0 1 

3 . 050E-Q3 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

7 . 490E-06 

0. 

0. 



-1 .270E-03 

—4 . 650E+00 

3 . 860E-02 

0. 

-8.970E-07 

0. 

0. 

0. 

0. 

0. 

—2 . 20OE-O1 

0. 

3 . 690E-02 
0. 

0. 

0. 

-1 .710E-03 

—4 . 300E-02 

-1 . 120E+00 

0. 

6.060E-06 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

3.590E-06 

0. 

0. 



—4 . 300E-05 

—2 . 610E-01 

-1 . 110E-03 

0. 

—7 . 640E-08 

0.' 

0. 

0. 

0. 

0. 

—2 . 350E-02 

0 . 

-6.970E-02 

0 . 

0 . 

0 . 



0 . 

0 . 

3. 330E-01 

1 .320E-01 

0 . 

0 . 

0 . 

0 . 

0 . 

0 . 

0 . 

0 . 
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0. 

0. 

0. 

0. 

0, 

0. 

0. 

—9 . 000E+0 1 

0. 
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C.l (Continued) 


C-5 


vt 

0 . 

0 . 


—6 . 05OE+O2 

0 . 


0 . 

0 . 


0 . 

0 . 


0 . 

0 . 
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0 . 
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0 . 
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-1 . 100E-04 
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0 . 
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B.240E-04 

B MATRIX: 
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del ta-ap 

u 

0 . 

0 . 
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0 . 

P 
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0 . 
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vt 
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NO NOISE INPUTS 


C MATRIX: 
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fig. c. 


lambda dot 0. 
mu dot 0, 


* 


eigenvalues 


real 

I MAG 

1 —6 . 833E+0 1 

0 . OOOE+OO 

2 -8.967E+01 

0. OOOE+OO 

3 —9 . 03 1E+0 1 

0. OOOE+OO 

4 -2.904E+01 

0. OOOE+OO 

5 —I . 539E+0 1 

7 . 068E+00 

6 — 1 . 539E+01 

-7. 068E+00 

7 -1 .797E+01 

0. OOOE+OO 

8 -4.662E+00 

4.734E+00 

9 —4 . 662E+00 

-4.734E+00 

10 -6 . 549E+00 

0. OOOE+OO 

11 -1.400E+01 

0. OOOE+OO 

12 —Z . 403E+00 

1 . 897E+00 

13 -2 . 403E+00 

-1 . B97E+00 

14 -2.216E+00 

0. OOOE+OO 

15 — 1 . 283E+00 

0. OOOE+OO 

16 -5.027E-01 

0. OOOE+OO 

17 —5 . 869E-01 

0. OOOE+OO 

18 -1.890E+00 

0. OOOE+OO 

19 — 1 . 1 50E-02 

1 . 664E-01 

20 — 1 . 150E-02 

-1.664E-01 

21 -1.662E-01 

0 . OOOE+OO 

22 -2. OOOE+OO 

0. OOOE+OO 

23 —6 . 15 IE— 02 

0 . OOOE+OO 

24 —8 . 217E-04 

3 . 040E-03 

25 -8 . 21 7E— 04 

—3 . 040E-03 

26 3.344E-06 

8.242E-04 

27 3.344E-08 

-8.242E-04 

28 -9.226E-05 

0. OOOE+OO 


FREQ 

6. 833E+01 
8 . 967E+0 1 
9 - 031E+01 
2 . 904E+0 1 
1 . 694E+01 
1 . 694E+01 
1 .797E+01 
6 . 644E+00 
6 . 644E+00 
6 . 549E+00 
1 . 400E+0 1 
3 . 061E+00 
3 . 061E+00 
2 . 216E+00 
1 . 283E+00 
5.O27E-0I 
5 . 869E-01 
1 . 890E+00 
1 -668E-01 
1 .668E-01 
1 . 662E-0 1 
2 . 000E+00 
6. 151E-02 
3. 149E-03 
3. 149E-03 
8.242E-04 
8 .242E-04 
9.226E-05 


DMPG 

1 . OOOE+OO 
1 . 000E+00 
1 . OOOE+OO 
1 . OOOE+OO 
9 . 088E-0 1 
9.088E-01 
1 . OOOE+OO 
7.017E-01 
7.017E-01 
1 .OOOE+OO 
1 .OOOE+OO 
7 . B49E-0 1 
7 . 649E-0 I 
1 . OOOE+OO 
1 . OOOE+OO 
1 . OOOE+OO 
1 . OOOE+OO 
1 .OOOE+OO 
6. 894E-02 
8 . 894E-02 
1 . OOOE+OO 
1 . OOOE+OO 
1 .OOOE+OO 
2 . 609E-01 
2.609E-01 
-4.058E-03 
-4.05BE-03 
1 . OOOE+OO 


I 

1 (Concluded) 


C-10 


C.2 Aircraft with Reduced-Order Augmentation 

Figure C.2 contains system matrices for the reduced-order 
augmentation. The reader will notice that many of the state 
variables have been eliminated. In particular, the augmentation 
system is reduced to three states, with one state each for the 
pitch, roll, and yaw axis augmentation systems. Output and 
control variables are the same as for the fully augmented 
aircraft. 
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C.3 System Dynamics Used for Pilot Modeling 

The system matrices used for predictions of closed-loop 
pilot/vehicle performance are presented in Figure C.3. These 
dynamics differ from the dynamics described above as follows: 


o All angle variables are in degrees. 

o The states "pipl" and "pip2" representing pipper motion 
are included. 

o Only two pilot inputs are included: 6 and 6 . 

e a 

o altitude has been removed as an output variable, and 
four new outputs are included: mu error and mu error 

rate, representing the difference between the vertical 
pipper displacement or rate and the position or rate of 
the LOS to the target (i.e., the vertical-axis tracking 
error )? and the displacement and rate of the pipper with 
respect to its nominal position within the HUD. 

i 

o Airspeed is retained as an output, but has zero value 
because of the removal of the airspeed state variable. 


When computing pilot response strategy, the OCM temporarily 
reduced the output vector to contain only those variables used by 
the pilot (a small subset of the output vector represented in 
Figure C.3.). Once a model solution was obtained, the full 
output vector was restored for the purposes of computing output 
variance scores. 
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